Distributed representation of books
Distributed representation of characters 、 Distributed representation of words 、 Distributed representation of sentences
I was thinking about it, and it seemed natural that books would also have their own distributed representation.
A distributed representation of a book is of course different from a "distributed representation of the title of a book as a short sentence"
Often the book's content and title do not match.
The book has a table of contents and a set of short sentences called chapter titles
There is of course a "Distributed representation of chapters" which is different from the distributed representation of this chapter title.
Books are often referred to as "p.XX in book XX
There is of course the "Distributed representation of pages" as well.
The mechanism that takes Distributed representation of this title as input and returns Distributed representation of this content is the [attention mechanism
For example, I have done KJ method with book covers as stickies
Clean space + KJ method experiment
This "sticky note position" is a two-dimensional vector
It is possible to mix this with distributed representations: Merging Distributed Representations.
Is rotational neglect appropriate?
---
This page is auto-translated from /nishio/本の分散表現. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.